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Abstract — The problem of objectively choosing a string of 
actions to optimize an objective function that is string submodular 
has been considered in |1|. There it is shown that the greedy 
strategy, consisting of a string of actions that only locally 
maximizes the step-wise gain in the objective function, achieves 
at least a (1 e J ) -approximation to the optimal strategy. This 
paper improves this approximation by introducing additional 
constraints on curvatures, namely, total backward curvature, total 
forward curvature, and elemental forward curvature. We show that 
if the objective function has total backward curvature a, then the 
greedy strategy achieves at least a ~(1 — e" CT ) -approximation of 
the optimal strategy. If the objective function has total forward 
curvature e, then the greedy strategy achieves at least a (1 — e)- 
approximation of the optimal strategy. Moreover, we consider 
a generalization of the diminishing-return property by defining 
the elemental forward curvature. We also consider the problem 
of maximizing the objective function subject to a string-matroid 
constraint. We investigate two applications of string submodular 
functions with curvature constraints. 



I. Introduction 

A. Background 

We consider the problem of optimally choosing a string of 
actions to maximize an objective function over a finite horizon. 
Let A be a set of possible actions. At each stage i, we choose 
an action from A. We use A — (oi, . . . , a^) to denote a 
string of actions taken over k consecutive stages, where cii <E 
A for i = 1,2, ...,k. We use A* to denote the set of all 
possible strings of actions (of arbitrary length, including the 
empty string). Let / : A* — > R be an objective function, where 
R denotes the real numbers. We wish to find a string Jlf e A*, 
with a length \M\ not larger than K, to maximize the objective 
function: 



(1) 



maximize f(M) 
subject to M G A*, \M\ < K. 

The solution to ((T), which we call the optimal strategy, 
can be found using dynamic programing (see, e.g. 10). More 
specifically, this solution can be expressed with Bellman's 
equations. However, the computational complexity of finding 
an optimal strategy grows exponentially with respect to the 
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size of A and the length constraint K. On the other hand, 
the greedy strategy, though suboptimal in general, is easy to 
compute because at each stage, we only have to find an action 
to maximize the step-wise gain in the objective function. The 
question we are interested in is: How good is the greedy 
strategy compared to the optimal strategy in terms of the 
objective function? This question has attracted widespread 
interest, which we will review in the next section. 

In this paper, we extend the concept of set submodular- 
ity in combinatorial optimization to bound the performance 
of the greedy strategy with respect to that of the optimal 
strategy. Moreover, we will introduce additional constraints 
on curvatures, namely, total backward and forward curvatures 
and elemental forward curvature, such that the greedy strategy 
achieves a good approximation of the optimal strategy. We will 
investigate the relationship between the approximation bounds 
for the greedy strategy and the curvature constraints. These 
results have many potential applications in closed-loop control 
problems such as portfolio management (see, e.g. [3]), closed- 
loop sensor management (see, e.g., and influence in social 
networks (see, e.g., (0). 

B. Related Work 

Submodular set functions play an important role in combi- 
natorial optimization. Let X be a ground set and g : 2 X — > R 
be an objective function defined on the power set 2 X of X. 
Let 1 be a non-empty set of subsets of X. Suppose that I 
has the hereditary and augmentation properties. Then, we call 
(X,l) a matroid [6|. The goal is to find a set in I to maximize 
the objective function: 



maximize g(N) 
subject to N E I. 



(2) 



Suppose that 1 = {S C X : card(.S') < k} for a given k, 
where card(S) denotes the cardinality of S. Then, we call 
(X,X) a uniform matroid. 

The main difference between ([TJ and © is that the objective 
function in (HJ depends on the order of elements in the 
string M, while the objective function in © is independent 
of the order of elements in the set N . To further explain 
the difference, we use V{M) to denote a permutation of a 
string M. Note that for M with length k, there exists fc! 
permutations. In (Q}, suppose that for any M 6 A* we have 
f(M) = f(P(M)) for any V. Then problem (QJ reduces to 
problem (0. In other words, we can view the second problem 
as a special case of the first problem. Moreover, there can be 
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repeated identical elements in a string, while a set does not 
contain identical elements (we note that this difference can be 
bridged by allowing multisets). 

Finding the solution to (O is NP-hard and a tractable 
alternative is to use a greedy algorithm. The greedy algorithm 
starts with the empty set, and incrementally adds an element 
to the current solution giving the largest gain in the objective 
function. Theories for maximizing submodular set functions 
and their applications have been intensively studied in recent 
years [7|-[31|. The main idea is to compare the performance 
of the greedy algorithm with that of the optimal solution. 
Suppose that the set objective function g is non-decreasing: 
g(A) < g{B) for all A C B; and g(0) = where denotes 
the empty set. Moreover, the function has the diminishing- 
return property: For all A C B C X and j E X \ B, 
we have g(A U {j}) - g{A) > g{B U {j}) - g{B). Then, 
we say that g is a submodular set function. Nemhauser et 
al. |7| showed that the greedy algorithm achieves at least a 
(1 — e _1 ) -approximation for © given that (X,I) is a uniform 
matroid and the objective function is submodular. Fisher et 
al. H | proved that the greedy algorithm provides at least a 1/2- 
approximation of the optimum for a general matroid. Conforti 
and Cornuejols [9| showed that if the function g has a total 
curvature c, where 

f g(X)-g(X\{j}) \ 
c = max < 1 -— — — - — > , 

^ x I 9{{j}) - .9(0) J 

then the greedy algorithm achieves at least -(1 — e~ c ) and 
-approximations of the optimal solution given that (X, I) 
is a uniform matroid and a general matroid, respectively. Note 
that c 6 [0, 1], and if c = 0, then the greedy algorithm 
is the optimal solution; if c = 1, then the result is the 
same as that in [7|. Vondrak [ 1 1 showed that the continuous 
greedy algorithm achieves a -(1 — e~ c )-approximation for any 
matroid. Wang et al. [110 provided approximation bounds 
in the case where the function has an elemental curvature 
constraint, which generalizes the notion of diminishing return. 

Some recent papers lfTl. llT2l - irT4l have extended the notion 
of set submodularity to problem ([T}. Streeter and Golovin lfP2l 
showed that if the function / is forward and backward 
monotone: f(M © N) > f(M) and f(M ffiJV) > f(N) 
for all M,N 6 A*, where © means string concatenation, and 
/ has the diminishing -return property: /(Mffi (a)) — f(M) > 
f(N © (a)) - f(N) for all a e A, M, N e A* such that M 
is a prefix of N, then the greedy strategy achieves at least a 



(1 



-approximation of the optimal strategy. The notion 



of string submodularity and weaker sufficient conditions are 
established in [ 1 1 under which the greedy strategy still achieves 
at least a (1 — e _1 )-approximation of the optimal strategy. 
Golovin and Krause lfT4ll introduced adaptive submodularity 
for solving stochastic optimization problems under partial 
observability. 

C. Contributions 

In this paper, we study the problem of maximizing sub- 
modular functions defined on strings. We impose additional 

'We gratefully thank Zengfu Wang for sending us a preprint of 1111 . 



constraints on curvatures, namely, total backward and forward 
curvatures, and elemental forward curvature, which will be 
rigorously defined in Section II. The notion of total forward 
and backward curvatures is inspired by the work of Conforti 
and Cornuejols |9|. However, the forward and backward alge- 
braic structures are not exposed in the setting of set functions 
because the order of elements in a set does not matter. The 
notion of elemental forward curvature is inspired by the work 
of Wang et al. ifTTl . We have exposed the forward algebraic 
structure of this elemental curvature in the setting of string 
functions. Moreover, the result and technical approach in IfTTl 
are different from those in this paper. More specifically, the 
result in [11 1 uses the fact that the value of a set function 
evaluated at a given set does not change with respect to any 
permutation of this set. However, the value of a string function 
evaluated at a given string might change with respect to a 
permutation of this string. In Section III, we consider the 
maximization problem in the case where the strings are chosen 
from a uniform structure. Suppose that the string submodular 
function / has total backward curvature with respect to the 
optimal strategy cr(0). Then, the greedy strategy achieves at 
least a (1— e^ 17 ^ )-approximation of the optimal strategy. 
Suppose that the string submodular function / has total 
forward curvature e. Then, the greedy strategy achieves at least 
a (1 — ^-approximation of the optimal strategy. We also gen- 
eralize the notion of diminishing return by defining elemental 
forward curvature 77. The greedy strategy achieves at least a 
1 — (1 — -w-) -approximation, where K v = (1 — 77 )/(l — rf). 
In Section IV, we consider the maximization problem in the 
case where the strings are chosen from a non-uniform structure 
by introducing the notion of string-matroid. Suppose that the 
string submodular function / has total backward curvature 
with respect to the optimal strategy a(0). Then, the greedy 
strategy achieves at least a 1/(1 + <r(0))-approximation. We 
also provide the approximation bounds for the greedy strategy 
when the function has total forward curvature and elemental 
forward curvature. In Section V, we consider two applications 
of string submodular functions with curvature constraints . 

II. String Submodularity, Curvature, and 
Strategies 

A. String Submodularity 

We now introduce notation (same as those in Q]) to define 
string submodularity. Consider a set A of all possible actions. 
At each stage i, we choose an action a,; from A. Let A = 
(01, <22, . . . , ttfe) be a string of actions taken over k stages, 
where G A, i = 1, . . . , k. Let the set of all possible strings 
of actions be 



A* 



{(ai, a 2 , . . . ,a k )\k = 0, 1, . . . and ai G 



1, 



Note that k = corresponds to the empty string (no action 
taken), denoted by 0. For a given string A = (a\, 0,2, ... , a^), 
we define its string length as k, denoted \A\ — k. If M = 
(o™, a™, . . . , a™J and N = (a™, , . . . , a£ 2 ) are two strings 
in A*, we say M = N if \M\ = \N\ and a™ = a? for each 
i = 1,2, . . . ,\M\. Moreover, we define string concatenation 
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we write M ^ TV if we 
. In other words, M is a 



I, is 



as follows: 

If M and TV are two strings in i 
have N = M ® L, for some L € 
prefix of TV. 

A function from strings to real numbers, / 
string submodular if 

i. / has the forward-monotone property, i.e., 

VM, TV e A* , f(M®N)>f{M). 

ii. / has the diminishing- return property, i.e., 

VM :< TV € A*,Va € A, 

/(M © (a)) - f(M) > /(TV © (a)) - /(TV). 

In the rest of the paper, we assume that /(0) = 0. 
Otherwise, we can replace / with the marginalized function 
/ — / (0). From the forward-monotone property, we know that 
j(M) > for all M € A*. 

We first state an immediate result from the definition of 
string submodularity. 

Lemma 1: Suppose that / is string submodular. Then, for 
any string TV = (n 1; n^, ■ ■ ■ , «|at|), we have 

\N\ 

/(JV)<£/((ni)). 
i=i 

The proof uses a mathematical induction argument and is 
omitted for brevity. 

B. Curvature 

We define the total backward curvature of / by 

f((a)®M)-f(M) \ 
f((a))-f(0) J' 

We define the total backward curvature of / with respect to 
string M e A* by 

er(M) = max (l - ^ f f> "/^ 1 (4) 

1 j iV 6 A*,0<|iV|<K\ f(N)-f{0) /' 

where if is the length constraint in (Q~|i. We will discuss the 
values <r(M) can take in the next section. Suppose that / is 
backward-monotone; i.e., VM, TV e A*,/(M © TV) > /(TV). 
Then, we have <r < 1 and / has total curvature at most a with 
respect to any M G A*; i.e, <r(M) < er VM e A*. This fact 
can be shown using a simple derivation: For any TV e A*, we 
have 

/(TVffiM)-/(M) = 

|JV| 

J2 /(K> • ■ • ,n\N\) © M) - f((n l+u . . . , n im ) © M), 

i=l 

where rii represents the ith element of TV. From the definition 
of total backward curvature and Lemma 1, we obtain 

\N\ 

f(N®M)-f(M)>^2(l-a)f(m) 

i=l 

> (l-a)f(N). 



Symmetrically, we define the total forward curvature of / 



a = max 

a£A,M£/ 



by 



max 

aSA.MGA* 



/(M©(a))-/(M) \ 



(5) 



/((«)) 

Moreover, we define the total forward curvature with respect 
to M by 

/(M©TV)-/(M) j 



e(M) = max 

ATeA*,0<|Af|<i<" 



1 



(6) 



f(N)-f(0 

If / is string submodular and has total forward curvature e, 
then it has total forward curvature at most e with respect to 
any M e A*; i.e., e(M) < e VM € A*. Moreover, for a string 
submodular function /, it is easy to see that for any M, we 
have e(M) < e < 1 because of the forward-monotone property 
and e(M) > because of the diminishing -return property. 

We define the elemental forward curvature of the string 
submodular function by 

f(M®{a i )®(a j ))-f(M®(a i )) 



max 

ai,ajeA,MGA* 



(7) 



f(M®( aj ))-f(M) 

For a forward-monotone function, we have r\ > 0. Moreover, 
note that the diminishing-return property is equivalent to the 
condition r) < 1. 

C. Strategies 

We will consider the following two strategies. 
1 ) Optimal strategy: Consider the problem ([TJ of finding a 
string that maximizes / under the constraint that the string 
length is not larger than K. We call a solution of this problem 
an optimal strategy (a term we already have used repeatedly 
before). Note that because the function / is forward monotone, 
it suffices to just find the optimal strategy subject to the 
stronger constraint that the string length is equal to K. In other 
words, the optimal strategy must be a string with length K. 

is called 



2) Greedy strategy: A string Gu = (a*, a^, . 



greedy if Vi = 1, 2, . . . , k, 



,a*_i,a<)) 



a* = argmax/((ai,a2, . 

diSA 

-/(K,a2,---X-i))- 

Notice that the greedy strategy only maximizes the step- 
wise gain in the objective function. In general, the greedy 
strategy (also called the greedy string) is not an optimal 
solution to (Q}. In this paper, we establish theorems which 
state that the greedy strategy achieves at least a factor of the 
performance of the optimal strategy, and therefore serves in 
some sense to approximate an optimal strategy. 

III. Uniform Structure 

Let I be the subset of A* with maximal string length K: 
I = {A e A* : \A\ < K}. We call I a uniform structure. 
Note that the way we define uniform structure is similar to 
the way we define independent sets of uniform matroids. We 
will investigate the case of non-uniform structure in the next 
section. Now (Q~|) can be rewritten as 

maximize f(M) 
subject to M £ I. 
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We first consider the relationship between the total curva- 
tures and the approximation bounds for the greedy strategy. 

Theorem 1: Consider a string submodular function /. Let 
O be a solution to £[). Then, any greedy string Gk satisfies 

(i) f{G K )>^{l-e-^°))f{0), 

(ii) f(G K ) > (1 - max, : K : e(G l ))/(0). 

Proof: (i) For any M e A* and any N = 
(oi, a 2 , . . . , 0|jv|) € A*, we have 

/(M©iV)-/(M) 

\N\ 

= J2(f( M © • • • > - /( M © K • • • , oi-i))) 

i=l 

Therefore, using the forward-monotone property, there exists 
an element aj 6 A such that 

/(m e (oi, . . . , oj-)) - /(M e (oi, . . . , %•-!)) 

> |^(/(M8iV)-/(M)). 

Moreover, the diminishing-retum property implies that 

f(M®( aj ))-f(M) 

> f(M 8 (oi, . • .,a 3 )) - /(Me (oi, . • ..oj-i)) 
>^(/(M®iV)-/(M)). 

Now let us consider the optimization problem (JTJ. Using 
the property of the greedy strategy and the above inequality 
(substitute M = G»_i and TV = O), for each i = 1, 2, . . . , K 
we have 

f(Gi)-f(Gi-i) 
> j^(f(Gi-i 8 0)- f(Gi-x)) 



Therefore, we have 



/(G K )>^/(0)+(l-^]/(^ ) 



ir-i 



i=0 



£(0) 
if 



a(O) 



A' 



i ! i - ^1 I f(0). 



Note that 
1 



a(O) 



1-1 



a(0) 
A 



.7(0) 



(l_ e -(°)) 



from above as A — > oo. In consequence, we obtain the desired 
result. 

(ii) Using a similar argument to that in (i), we have 

/(GO - /(G;_0 

> ^(/(Gj-ieo)-^!)) 

> ^(/(G,-i) + (1 - e(G i _i))/(0) - /(Gi-i)) 
= l(l-e(G i _i))/(0). 



Therefore, by recursion we have 



>E-ki-^-i))/(o) 



a 

i=l 

> ljf(l - . max e(G0)/(O) 
= (1-. max e(G0)/(O). 



Under the framework of maximizing submodular set func- 
tions, similar results are reported in [9 1. However, the forward 
and backward algebraic structures are not exposed because 
the total curvature in J5] does not depend on the order of 
the elements in a set. In the setting of maximizing string 
submodular functions, the forward and backward algebraic 
structures are illustrated in the above theorem. To explain 
further, let us state the results in a symmetric fashion. Suppose 
that the diminishing-return property is stated in the backward 
way: /((a) 8 M) - f(M) > /((a) ®N)- f(N) for all a e A 
and M,N £ A* such that N = (oi, . . . , a k ) 8 M. Moreover, 
a string Gk = (a\, a^, ■ • ■ , a£) is called backward-greedy if 



a* = argmax/((ft ! ,a-_ 1 , 



>«2> a l)) 

-/(«_i,..., aD) Vi=l,2,...,fc. 



Then, we can derive bounds in the same way as Theorem 1, 
and the results are symmetric. 

The results in Theorem 1 implies that for a string sub- 
modular function, we have cr(0) > 0. Otherwise, part (i) 
of Theorem 1 would imply that /(Gk) > /(G), which is 
absurd. Moreover, if the function is backward monotone, then 
cr (G) < 1. From these, we get the following result, which is 
also derived in [12 J. 

Corollary 1: Suppose that / is string submodular and back- 
ward monotone. Then, 



f(G K ) > (1 



(l-i)*)/( )>(i 



- l )f{o). 



Next, we use the notion of elemental forward curvature to 
generalize the diminishing-return property and we investigate 
the approximation bound using the elemental forward curva- 
ture. 

Theorem 2: Consider a forward-monotone function / with 
elemental forward curvature 77. Let O be an optimal solution to 
©• Suppose that f{G t © O) > f{0) for i = 1, 2, . . . , K - 1. 
Then, any greedy string Gk satisfies 



1 



f(G K ) = f(0) ^l-(l-_)«j, 
where K v = (1 - ?7 K )/(1 - rj) if ry ± 1 and K,, = A if 

n = 1. 

Proof: We know that rj = 1 is equivalent to the 
diminishing-return property. The proof for this case is given 
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in |[T). Now consider the case where 77 7^ 1. For any 
M, A € A* and |M| < A', there exists a G A such that 

f(M®N)-f(M) 

\N\ 

= 5^(/(M 8 (oi, . . . , a,)) " /(M © (oi, . . . , Oi-i))) 

i=l 

|JV| 

<^^" 1 (/(M©a i )-/(M)) 

i=l 

< (1 + 7? + r/ 2 + . . . + ??' iV '~ 1 )(/(M 8 a)- /(M)) 
l_^l 



1-ry 



-(/(M©a)-/(M)). 



Now let us consider the optimization problem ([T) with 
length constraint K. Using the property of the greedy strategy 
and the assumptions, we have for i = 1, 2, . . . , K, 

f(Gi) - f(Gi-l) 



> 



> 



1 


- f] 


1 - 


-T] K 


1 


- V 


1 - 


-T} K 



(/(Gi_i © O) - /(GU)) 
(/(0)-/(Gi_i)). 



1 K 

Let fjf^ = . Therefore, by recursion, we have 
f(G K ) > -^f(O) + (1 - -L)f(G K -i) 



K-l 



Al ? i=o At » 



Because 1 — (1 — ^-) is decreasing as a function of 77 S 
[0, 1], we obtain the following result, which is reported in |fl]. 

Corollary 2: Consider a string submodular function /. Let 
O be a solution to |Q). Suppose that /(Gj © O) > f(0) for 
? = 1, 2,..., A — 1. Then, any greedy string Gk satisfies 

f(G K ) > (1 - (1 - ^) K )f(0) > (1 - e~ l )f{0). 

Next we combine the results in Theorems Q] and [2] to get 
the following result. 

Proposition 1: Consider a forward-monotone function / 
with elemental forward curvature 77. Let O be a solution to 
(HJ. Then, any greedy string Gk satisfies 

a) /(GK)>^(i-(i-4?r)/(o). 

(ii) f(G K ) > (l-max j=1| ..., A: _ie(G i ))^/(0). 

The proof is given in Appendix A. We note that the 
condition f(Gi © O) > /(O) in Theorem 2 is essentially 
captured by cr(O). 

IV. Non-uniform Structure 

In the last section, we considered the case where 7 is a 
uniform structure. In this section, we consider the case of non- 
uniform structures. 



(8) 



We first need the following definition. Let M = 

(mi, . . . ,m\M\) and N — (m, • • • , n\N\) be two strings in 
A*. We write M -< N if there exists a sequence of strings Li 
such that 

N = Lx © (mi, . . . , mjj © L2 © (^ii+i, • • • , "2j 2 ) © 
... © (m ifc _ 1+ i,. . .,m| M |) © L fc+ i. 

In other words, we can remove some elements in N to get M. 
Note that -< is a weaker notion of dominance than -< defined 
earlier in Section II. 

Now we state the definition of a non-uniform structure, 
analogous to the definition of independent sets in matroid 
theory. A subset / of A* is called a non-uniform structure 
if it satisfies the following conditions: 

1) / is non-empty; 

2) Hereditary: VM E I, N ~< M implies that N £ I; 

3) Augmentation: VM,N € / and \M\ < \N\, there exists 
an element x € A in the string such that M © (x) E I. 

By analogy with the definition of a matroid, we call the pair 
(A, J) a string-matroid. We assume that there exists A such 
that for all M € I we have |M| < if and there exists a A e I 
such that |A| = K. We call such a string A a maximal string. 
We are interested in the following optimization problem: 

maximize /(A) 
subject to A e I. 

Note that if the function is forward monotone, then the 
maximum of the function subject to a string-matroid constraint 
is achieved at a maximal string in the matroid. The greedy 
strategy Gk — (a*, ■ ■ ■ , at) in this case is given by 

a* = argmax f((a* 1 ,a* 2 ,...,a*_ l ,a i )) 

a.i£A and (a* ,...,a^_ 1 

-f((al,a* 2 ,...,a*_i)) V* = 1, 2, . . . , k. 

Compared with (HJ, at each stage i, instead of choosing at 
arbitrarily in A to maximize the step-wise gain in the objective 
function, we also have to choose the action aj such that the 
concatenated string (o*,...,Oj_ 1 ,Oi) is in the non-uniform 
structure I. We first establish the following theorem. 

Theorem 3: For any A € I, there exists a permutation of 
A, denoted by V{N) = (n.1,712, . . . , h\N\), such that for i = 
1, . . . , I A| we have 

© («0) - < /(GO - 

Proof: We prove this claim by induction on i = 
|A|,...,1. If i — |A|, consider Gijv|-i and A, we know 
from Axiom 3) of string-matroid that there exists an element 
of A, denoted by jxijyi (we can always permute this element 
to the end of the string with a certain permutation), such 
that G|jv|-i © (^Ijvi) G !• Moreover, we know that the 
greedy way of selecting at N i gives the largest gain in the 
objective function. Therefore, we obtain /(Gijv|-i © (^i)) — 
/(G|iv|-i) < /(G|jv|) - /(G|jv|_i). 

Now let us assume that the claim holds for all i > io and 
the corresponding elements are {nj +i, . . . , nijvi}. Next we 
show that the claim is true for i = i . Let Ai be the string 
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after we remove the elements in {hi a+ i, . . . , nijvi} from the 
original string N. We know that |Gj _i| < |iVj D |, therefore, 
there exists an element from Ni , denoted by fii , such that 
Gio-l © ("-i ) ^ !■ Using the property of the greedy strategy, 
we obtain /(G; -i©(n io ))-/(G io _i) < /(G io )-/(G io _i). 
This concludes the induction proof. ■ 

Next we investigate the approximation bounds for the 
greedy strategy using the total curvatures. 

Theorem 4: Let O be an optimal strategy for (|8). Suppose 
that / is a string submodular function. Then, a greedy strategy 
Gk satisfies 

(i) f(G K ) > 1+^/(0), 

(ii) f{G K ) > (1 - e(G K ))f(0). 

Proof: (i) By the definition of the total backward curva- 
ture, we know that 

f(G K © O) - f(0) > (1 - a(0))f(G K ). 

Let O = (oi, . . . , ok)- We have 

f(0) < f(G K © O) - (1 - a(0))f(G K ) 

= /(Gk) - (1 - a(0))f(G K ) + f(G K © O) - /(Gk). 
Moreover, by the diminishing-retum property, we have 

f{G K ®0)-f{G K ) 

K 

i=l 
K 



< 



E(/( G ^©(°0)-/(G^)). 



By Theorem 3, we know that there exists a permutation of O: 

V(0) = (ox, . . . , d|o|) such that 

/(Gi_i © (o,)) - /(Gi-i) < /(GO - /(Gi_i), 

for i — 1, . . . , K. Therefore, by the diminishing-retum prop- 
erty, we have 

K 

E(/( G * © (Pi)) - f(Gic)) 

i=l 

K 

< © (pi)) - /(Gi_i)) 

i=l 
if 

From the above equations, we have 

/(O) < /(G^) + f(G K ) - (1 - a{0))f{G K ) 
= (1 + a(p))f(G K ). 

We obtain the desired result. 

(ii) From the definition of total forward curvature, we have 

f(G K © O) - f(G K ) > (1 - e(Gjf ))/(0). 

From the proof of part (i), we also know that /(Gk © 
O) - /(G K ) < /(Gk). Therefore, we have f{G K ) > 
(1- £ (Gk))/(0). ■ 



The inequality in (i) above is a generalization of a result on 
maximizing submodular set functions with a general matroid 
constraint [8|. The submodular set counterpart involves total 
curvature, whereas the string version involves total backward 
curvature. Note that if / is backward monotone, then cr(0) < 
1. We now state an immediate result from Theorem 4. 

Corollary 3: Suppose that / is a string submodular function 
and / is backward monotone. Then, the greedy strategy 
achieves at least a 1/2-approximation of the optimal strategy. 

Next we generalize the diminishing-retum property using 
the elemental forward curvature. 

Theorem 5: Suppose that / is a forward-monotone function 
with elemental forward curvature -q. Suppose that /(Gk © 
O) > f(0). If 77 < 1, then 

/(Gk) > ^/(O). 



l+ ^r/(°)- 



If f] > 1, then 

/(Gk) > 

J- T 

Proof: Let O = (oi, . . . , ok)- From the definition of 
elemental forward curvature, we know that 

f(G K ®0)~f(G K ) 

K 

= E( f ® (°i> • • • ' °o) - ^ Gk ® • • • - °<-i))) 



< 



K 

E 

i=l 



(f(G 



K-l 



(oi)) - /(Gk-i))^ 



vEli(f(G K -i © ( 0i )) - /(Gk-i)), if V < 1 



< 



»7 K E<=i(/(Gjc-i © (<*)) - /(Gk-i)), if 77 > 1. 



From Theorem 3, we know that there exists a permutation 
V of O: V(0) = (6i,...,6 K ), such that 

/(Gi_! © ft)) - /(Gi-x) < /(Gi) - /(Gi-x), 

for i = l,...,.ff. Moreover, by the definition of elemental 
forward curvature, we have 



K 

E 

i=l 
K 



(/(G 



K-i © (0*)) - /(Gk-i)) 



= V(/(G 



K 



k-i © (6,)) ~ /(Gk-i)) 



<^r7^- i (/(G i _ 1 ffi(6 i ))-/(G i _ 1 )) 



E l t 1 (/(G i - 1 ffi(6 i ))-/(G i _ 1 )), 



< 



< 



if r7 < 1 



E* © (60) - /(Gj_i)), if 77 > 1. 



/(Gk) 



if 77 < 1 



V^fiGx), if77>l. 
Therefore, we have 

, rr3 x< f(l + r?)/(GK), ifr?<l 

71 ; " 1(1 ©^-^/(Gk), ifr?>l. 
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This result is similar to that in |[TD . However, the second 
bound in Theorem [5] is different from that in ifTTl . This is 
because the proof in IfTTl uses the fact that the value of a 
set function evaluated at a given set does not change with 
respect to any permutation of this set. However, the value of a 
string function evaluated at a given string might change with 
respect to a permutation of this string. Recall that the elemental 
forward curvature for a string submodular function is not larger 
than 1. We obtain the following result. 

Corollary 4: Suppose that / is a string submodular function 
and J{Gk © O) > f(0). Then, the greedy strategy achieves 
at least a 1/2-approximation of the optimal strategy. 

Now we combine the results for total and elemental curva- 
tures to get the following. 

Proposition 2: Suppose that / is a forward-monotone func- 
tion with elemental forward curvature r\. Then, a greedy 
strategy Gk satisfies 

(i) f{G K ) > ^/(O), 

(ii) f(G K ) > ^f^f(0), 

where fj — -q if rj < 1 and fj — rj 2K ~ 1 if r\ > 1. 

The proof is given in Appendix B. From these results, we 
know that when / is string submodular, ?y e [0,1] and we must 
have er(O) + r\ > 1 and e(Gjf) + r\ > 1. From Theorems Q] [2] 
H] and [5] we know that the approximations of greedy relative 
to optimal get better as the total forward/backward curvature 
or the elemental forward curvature decreases to 0. However, 
the above inequalities indicate that the approximations with 
total curvature constraints and elemental forward curvature 
constraint cannot get arbitrarily good simultaneously. When 
equality in either case holds, the greedy strategy is optimal. A 
special case for this scenario is when the objective function is 
string-linear. f(M®N) = f(M) + f(N) for all M, N G A*, 
i.e., r\ — 1 and a = e = 0. Recall that < cr(0) < a and 
< e(G K ) < e. 

Remark: The above proposition and the discussions after- 
ward easily generalize to the framework of submodular set 
functions. 

V. Applications 

In this section, we investigate two applications of string 
submodular functions with curvature constraints. 

A. Strategies for Accomplishing Tasks 

Consider an objective function of the following form: 

n I k ^ 

f((a 1 ,...,a k )) = -^2[l-l[(l- P i(a j )) 

We can interpret this objective function as follows. We have 
n subtasks, and by choosing action ctj at stage j there is a 
probability p\ (aj ) of accomplishing the ith subtask. Therefore, 
the objective function is the expected fraction of subtasks 
that are accomplished after performing (ai, . . . , a^). Suppose 
that p\ is independent of j for all i; i.e., the probability of 
accomplishing the ith subtask by choosing an action does not 
depend on the stage at which the action is chosen. Then, it 



is obvious that the objective function does not depend on the 
order of actions. In this special case, the objective function is 
a submodular set function and therefore the greedy strategy 
achieves at least a (1 — e~ 1 )-approximation of the optimal 
strategy. Moreover, it turns out that this special case is closely 
related to several previously studied problems, such as min- 
sum set cover [32], pipelined set cover 11331 . social network 
influence [34|, and coverage-aware self scheduling in sensor 
networks [35|. In this paper, we generalize the special case 
to the situation where p? depends on j. Applications of this 
generalization include advising campaign for political voting, 
etc. Without loss of generality, we will consider the special 
case where n — 1 (our analysis easily generalizes to arbitrary 
n). In this case, we have 

k 

/(K..., at )) = i-n(i-p''y- 

3=1 

For each a E A, we assume that p*{a) takes values in 
[L(a), U(a)\, where < L(a) < U(a) < 1. Moreover, let 

1 - U(a) 

c(a) = T^Wy 

Obviously, c(a) £ (0, 1). The forward-monotone property is 
easy to check: For any M, N g A*, the statement f(M®N) > 
f(M) is obviously true. 

1) Uniform Structure: We first consider the maximization 
problem under the uniform structure constraint. The elemental 
forward curvature in this case is 

(i-p'K)V( aj ) 



max ■ 



p\a,j) 



Suppose that U = max a£ A U(a) and L = min ae A L(a). Then, 
we have 

(l-L)U 



n 



< 



for all possible combinations of probability values p 7 ', j = 
1, . . . . Note that the function is submodular if and only if 77 < 
1 . From the above equation, we conclude that / is submodular 
if 

(l-L)U 



L 



< 1. 



Therefore, a sufficient condition for string submodularity is 



L- 1 - IJ- 1 < 1. 



In Theorem Q] instead of calculating the total backward 
curvature with respect to the optimal strategy, we calculate 
the total backward curvature for K < \M\ < 2K: 



max 

aeA,K<\M\<2K 



(9) 



1 



mm s 

a£A,K<\M\<2K I 



[ f((q)®M)-f(M) \ 
\ /((a))-/(0) / 

f /((a) 8 M) — f(M) } 



/((a))-/(0) j 



We have 

/((q)®M)-/(M) 
/((a))-/(0) 

pHa) 



x 



We then provide an upper bound for the total backward 
curvature for all possible combination of pp . The minimum of 
the above term is achieved at p*(aj) — U and p* +1 {a,j) = L: 

\ .f{{a)®M)-f{M) \ 

mill < — — rr ; r > 

a£A,K<\M\<2K { /((a)) - /(0) J 

(l-U) k -(l-p 1 (a))(l-L) k 



> min 

a£A,K<k<2K 



> min 

K<k<2K 



pi (a) 

(1 - U) k - (1 - L) k+l 
L 



From this we can derive an upper bound for the total backward 
curvature and use the upper bound in Theorem 1 . For example, 
suppose that (1 - U) k /(l — L) k > 1 — L for all K <k< 2K. 
Then, we achieve the minimum at 2K — 1: 



(1 - U) k - (l-L) k+1 
mm 

K<k<2K £ 

2K 



_ (1-EQ 2 *- 1 -(!-£) 
L 

Moreover, it is easy to verify that a(0) < a. We can therefore 
use <7 to derive a lower bound for the approximation of the 
greedy strategy. 

Instead of calculating the total forward curvature with 
respect to the greedy strategy Gi, we calculate 

* = max (l - ) ) (11) 

a^<\M\<i+K { /((a)) - /(0) J 

. f f(M ® (a)) - f(M) \ 

= 1 — mm < 77 rr ; > (12) 

aeA,i<|M|<i+x t /((a)) - /(0) J 



= 1 — min 

aeA,i<\M\<i+K 

> l-{l-U) i+K - X . 



pi (a) 



(13) 
(14) 



It is easy to show that e(Gj) < ej. Moreover, we have 



max £(6*0 < max e< < 1 - (1 - U) 2K ~ 2 . 

i—l,... 7 K — l i— 1,...,K"— 1 

We can substitute this term in Theorem Q] and get a lower 
bound for the approximation of the optimal strategy that the 
greedy strategy is guaranteed to achieve. 

In Theorem [2] we need the additional assumption that 
f(Gi ffiO) < f(0) for i = 1,...,K - 1, which can be 
written as 

Y[(l-pHo J ))>l[(l-p^a*))f[(l-pi+*(o J )). (15) 

0=1 t=l 3=1 



We know that 



j=l 3 = 1 



and 



i K K 

n(i-p j 'K*))n( i -^' +i K)) < n( i - L ^))(iv(^))- 

i=l 3=1 j=l 



Therefore, a sufficient condition for (fT5t is 

1 u ,^ nf=i(i-^)) i r , . 
nf =1 (i-^)) /i 

Let c = min a6 A c(a). Suppose that we have 

pVi)>l-c K 

Then, f{G l ® O) < f(0) for i = 1, . . . , K - 1. 

2) Non-uniform Structure: The calculation for the case of 
non-uniform structure uses a similar analysis. For example, in 
TheoremU] the calculation of the total backward curvature can 
be calculated in the same way as the case of uniform structure. 

Now let us consider the backward monotone property re- 
quired in Theorem [5] /(Gk © O) > f{0). This condition is 
much weaker than that in Theorem [2] and can be rewritten as 

K K K 

U(l -p>( 0j )) > H(l-pJ(aj)) H(l -pt +K (oo)). 

3=1 t=l j=l 

A sufficient condition for the above inequality is 1 — U > 
(1 — L) 2 . Recall that the function is string submodular if 

(1 - L)U 

T) < < 1. 

L 

Combining the above two inequalities, we have 

(1-L)U ^ (1-L)(1-(1-L) 2 ) 



n 



< 



< 



L L 
= (1-L)(2-L) < 1. 

Therefore, we obtain 

1 - 1 
L > 1 and U < -, 

a a 

where a = is the golden ratio. 

Now let us consider the special case where p^(a) is non- 
increasing over j for each a G A. It is easy to show that the 
function is string submodular. Moreover, the elemental forward 
curvature is 

cti,a,j p l yaj) 
< max(l —p l (di)) 

(Li 

<1 — L. 

Therefore, using this elemental forward curvature bound, we 
can provide a better approximation than (1 — e _1 ) for the 
greedy strategy. 

Consider the special case where p J (a) is non-decreasing 
over j for each a € A. In this case, we have 

<7(u) < a = 1 — mm < -— — ; — r > 

aek,K<\M\<2K \ /((a))-/(0) J 

| AT | 

<i- JJ(i-^( Oj 0) 

3=1 

^l-il-UfK- 1 . 

Therefore, we can provide a better approximation than (1 — 
e _1 ) for the greedy strategy. 
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B. Maximizing the Information Gain 

In this part, we present an application of string submodular 
function on Bayesian estimation. Consider a signal of interest 
x, which takes value on M. N with normal prior distribution 
Af([i,Po). In our example, we assume that the dimension 
N = 2. However, our analysis easily generalizes to dimen- 
sions larger than 2. Let D denotes all the diagonal positive- 
semidefinite 2x2 matrices with power (trace) constraint: 

3 = {Diag(V^, \/T _ e) : e e [0, 1]}. 

At each stage i, we choose a measurement matrix A{ e D to 
get an observation t/j, which is corrupted with additive zero- 
mean Gaussian noise LJ{ ~ Af(0, R 1 ^)'- 



y, 



Aj.x ■ 



Let the posterior distribution of x given (y%,y 2 , ■ ■ ■ ,Vk) be 
N(x k ,P k ). Moreover, the recursion for Pk is given by 



p^^p^+aurd-'ah 



Pn 



E^i 



Ai. 



The entropy of the posterior distribution of x given 
{Vi, 2/2, • ■ • , Vk) is H k = \ logdet P k + log(27re). We define 
the information gain given (Ai,A 2 , ■ ■ ■ ,A k ) by 



f((A u A 2 ,...,A k )) 



H 
1 



H k 



(logdetPo-logdetP fc 



The objective is to choose a string of measurement matrices 
subject to a length constraint K such that the information gain 
is maximized. 

The optimality of greedy strategy and measurement ma- 
trix design problem are considered in [37 1 and [38], re- 
spectively. Suppose that the additive noises are indepen- 
dent and identically distributed. Then, it is easy to see that 
f((A 1 ,A 2 , . . . , A k )) = f(P(A 1 ,A 2 , . . . , A k )) for all permu- 
tation V . Moreover, the information gain is a submodular set 
function and /(0) = [36|. Therefore, the greedy strategy 
achieves at least a (1 — e~ 1 )-approximation of the optimal 
strategy. 

Consider the situation where the additive noises are indepen- 
dent but not identically distributed. Moreover, let us assume 
that = erf I, where I denotes the identity matrix. In other 
words, the noise at each stage is white but the variances at 
depend on i. The forward-monotone property is easy to see: 
We always gain by adding extra (noisy) measurements. 

Now we investigate the sensitively of string submodularity 
with respect to the varying noise variances. We claim that the 
function is string submodular if and only if a\ is monotone 
non-decreasing with respect i. The sufficiency part is easy to 
understand: Because the measurement yi becomes more noisy 
as i increases, the information gain at a later stage certainly 
cannot be larger than the information gain at an earlier stage. 
We show the necessity part by contradiction. Suppose that 
the function is string submodular and there exist k such that 
Cfc > ffe+i- Suppose that the posterior covariance at stage 



fc — 1 is Diag(sfc_i, ifc_i) and we choose A k = Diag(l,0), 
A k+1 = Diag(0, 1). We have 

f(A k A k+1 ) - f(A k ) = log(l + tkcr^) 
= log(l + ife-i^+i) > log(l + tk-iol 1 ) 
= f(A k+1 ) - f(0). 

This contradicts with the diminishing-return property and 
finishes the argument. In fact, it is easy to show that r) < 1 if 
and only if the sequence of noise variance is non-decreasing. In 
this case, the greedy strategy achieves at least a factor (better 
than (1 — e -1 )) of the optimal strategy. 

For general cases where the noise variance sequence is 
not necessarily non-decreasing. We will provide upper and 
lower bounds for the elemental forward curvature. The lower 
bound of the elemental forward curvature characterizes the 
best bound for the greedy strategy we can possibly obtain. The 
upper bound of the elemental forward curvature characterizes 
the worst bound for the greedy strategy we can possibly 
obtain. Instead of considering the forward elemental curvature 
directly, it suffices to calculate the curvature over all M such 
that |M| < 2K - 2: 



ri = max 

A i ,A j Gl,\M\<2K-2 



f{M®{A 3 ))-f{M) 



(16) 



It is easy to see that f\ < r/ and we can use f\ to improve the 
results in Theorems 2 and 5. 

For simplicity, let Pq = Diag(,so, to)- Without loss of gen- 
erality, we assume that sq > to. Let M — (Ai,A 2 , . . . , A| ) 
where A k = Diag(^:, ^1 - e k ) for k = 1,...,\M\. Let 



P\m\ =Diag(s| M |,*| M |) where 



\M\ 



-i 



i=l i=l 

and sj]^ + = S q 1 + t^ 1 + £i=i a^ 2 . Consider the 
special case where A, t = Diag(l,0) and Aj = Diag(0, 1). 
The denominator of ( TTol l can be written as 

f(M 8 (Aj)) - f(M) = log(l + t m a-^ +l ). 

The numerator in ( [To! can be written as 

f(M®(A i )®(A j ))- f(M®(Ai)) 

= l0g(l +i|M| + lO-|M| +2 )- 

Therefore, we have 



fj > max 



log(l + t m+l a^ +2 ) 



\M\<2K-2 log(l + t| M |0-|J| +1 ) 



(17) 



We know that t\ M \ +1 = t\ M \ > (t 1 + £rfi a i 2 ) 1 , where 
= is achieved when e k = for fe=l,...,|M|. Let 



k = are max 



r - 2 

\M\+2 



\M\=0,....2K-2 CT| M | + 1 
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If cr fc+2/ (7 fc+i — !• then (fTTli is a monotone increasing function for all M with length K. Suppose that a, g [a, 6] for all z. 
of ti M |. We obtain Let a* — Diag(v / e*, \/l — e*) and M = (oi, . . . , or-), where 



> 



bg(l + fr)<7fcjg) 

bg(l + to<7fe+ X ) 



a t = Diag( v /e7, \/l — et) for all t. The inequality we need to 
verify can be written as 



A" 



^ a k+il a kt\ > 1> tnen *E) is a monotone decreasing 



function of fij^i. We obtain 



> 



2 1 



loga+^+Eti^ 2 )- 1 ^) 

Now let us further assume that cr, randomly takes a value 
from [a,b], where < a < b. We wish to provide a lower 
bound for fj for all possible realization of noise variances. 
From (JTTJ, we obtain 



fj > max 



log(l + t| M |6-^ 



\M\<2K-2 log(l + i|M| a_2 ) ' 



Note that the above lower bound is a monotone increasing 

log(l+^- 2 ) 



function of iijm. We obtain 



> 



log(l + i a~ 2 )' 
Next we derive the upper bound for fj. We first derive an 
upper bound for the numerator in (TT6l , which is given by ([T8] 
on the next page. 

We then derive the lower bound of the denominator in 
( [Tol l. It is easy to show that the minimum is achieved at the 
boundary: 

f(M ® (Aj)) - f(M) > 

min(log(l + t|M|o-|M| +1 ),log(l + S|Af|o-|^| +1 )) 

> log(l + min(s| M |cr | ] l 2 | + 1 ,<| M |Cr |A 2 |+1 )) 

2A-2 

> log(l + fe 1 + V ai 2 )-\ minar 2 ). 



log(l + soOi V + Y ^+iet))x 
t=i 

A 

(1 + i (ar 2 (l - e*) +Y, ^t+xi 1 ~ e *))) 
t=i 

> log(l + So (J2 °t 2 et))(l + to(£ ar 2 (l - e t ))). 
t=i t=i 

We first calculate the value of e*. It is easy to show that the 
objective function after applying (a*) achieves the maximum 
when 

Because e* can only take values in [0,1], in the case where 
(to 1 — Sq 1 )/ cr^ 1 > 1, the maximum is achieved at e* = 1. 
We will consider this case and the analysis for the case where 
(£q 1 — Sq 1 )/o'i 1 < 1 is similar and omitted. Therefore, to 
show the above inequality, it suffices to show 



A 



A 



log(l + so^x 2 + (so Y CT t +i e *))(l + *(>E - e*))) 

t=i t=i 

A A 

> log(l + s (]T ^ 2 e f ))(l + ^'(1 - <*))). 

t—1 t=l 

Removing the log on both sides of the inequality, we obtain 

A A 

(1 + s Y ^+ie t )(l + toY a T+x (1 - e 0) 



i=l,...,2K 



Therefore, we can derive an upper bound for the curvature as 
follows: 



< 



+ .s 0( x 1 2 (l + i ^c7- + 2 1 (l-e t )) 

i=l 

A A 

> (1 + s Y CT r 2 e*)(l + to Y a r 2 (l - et))- 



t=l 



4=1 



log 4(1 + s t 1 + s Efcfi CT i 2 )(! + ~ ^"'.''-ir 17 ' ) Rearranging terms, we obtain ([19), where 



1 if cr^ < 



io g (i + (*o 1 + E 2 fr 2 ^r 2 )- 1 "i=i 2K ^ 2 ) 

Using this upper bound, we can provide an approximation 
bound for the greedy strategy. We note that this upper bound 
is not extremely tight in the sense that it does not increase 
significantly with K only if so or err 2 are sufficiently small. 

Now consider the case where Cj randomly takes a value 
from [a, b], where < a < b. We wish to provide an upper 
bound for fj for all possible realization of noise variances. 
Therefore, we have 



a^ 2 and l t = if a^ 2 x > err 2 . 

From this we obtain a sufficient condition for /((a*) 
M) > f(M) to hold 

K 2 



2 > — h{a- z +b- z ) + l. 



f) < 



log |(1 + Soto 1 + 2s ^a- 2 )(l + ( g+°: 2 2 } ) 



log(l + < (l + to(2^-2)a- 2 )- 1 6- 2 ) " 

For Theorem 2, we need to have f{Gi © O) > f(0) for 
i = 1, 2, . . . , K — 1. Let a* e D be a greedy action. We will 
provide a sufficient condition such that /((a*) © M) > f(M) 



a- 2 - b~ 

We have shown before that the elemental curvature is not 
larger than 1 if and only if the noise variance is non- 
decreasing. Moreover, if the above inequality holds, which 
requires that either the length of the variance interval [a, b] or 
K is sufficiently small, then we can get the (1 — e _1 ) bound. 

VI. Conclusion 

In this paper, we have introduced the notion of total for- 
ward/backward and elemental forward curvature for functions 
defined on strings. We have shown that the greedy strategy 
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f(M © (Ai) © (Aj)) - /(M © (A)) = log(l + S|M|+i^|M|+2 e i)( 1 + t |A/|+i^|A?|+ 2 ( 1 - e i)) 

= l0 g( S ^f| + l + Cr |M|+2 e j)( t |Af| + l + a \M\+2( l - e l)) + logS|M| + l<|M| + l 



<log 



log 



log 



'|M|+1 ^ "1^/1+2^ ^ |M| + 1 ^ ^|M| + 



+ max(-log(, S - 1 + ^ a- 2 )to 1 ,-logso 1 (to 1 + ^ err 2 )) 



,-1 , ,-1 , ^|M|+2 „-2 



'0 



|M| + 1 



l + S t Q + S £i=l CT t 



log^o^ <*~i 



_-l , .-1 , y-|M|+2 -2 



log 



'0 



- H 2 + s \ 2 \ (to i +^ 2 ) 



(18) 



A 



A' 



A" 



s J2 et(*t+i - *t 2 ) + *o ~ e *)(^ f +i ~ *t 2 ) + soctx 2 (l + hJ2 "t+ii 1 ~ e 0) 
t=i t=i t=i 

A A A A 

A A 

> so $>r+i - ^r 2 )i* + *o 5>r+i - ^r 2 )(i - 1*) 



4=1 



A 



A A 



s ^ 3 (l + toE ^+1(1 - et)) + *o*o(&- 4 - a" 4 )^ e t )(^(l - e*)) 
K 2 



t=i 

> s (b-' 2 - a' 2 ) + s b- 2 + ^-sotoib- 4 - a~ 4 



t=i t=i 



(19) 



achieves a good approximation of the optimal strategy with 
constraints on these curvatures. Our results contribute sig- 
nificantly to our understanding of the underlying algebraic 
structure of string submodular functions. Moreover, we have 
investigated two applications of string submodular functions 
with curvature constraints. 

Appendix A 
Proof of Proposition 1 

(i) We know that 77 = 1 is equivalent to the diminishing- 
return property. The proof for this case is the same as that 
of Theorem 1. Now consider the case where 77 ^ 1. For any 
M, N e A* and \M\ < K, there exists a e A such that 

f(M®N)-f(M) 

l- V \N\ 



1-7? 



■(/(M©o)-/(M)). 



Now let us consider the optimization problem ([T) with 
length constraint K. Using the property of the greedy strategy 
and the monotone property, we have 



fid) - /(Gi_0 > 



1-7? 



> 



1 - T] K 
1—7? 



1 — T] 



(/(Gi_! © O) - f(Gi-i)) 
K (f(0)-a(0)f(G i . 1 )). 



Let K n = . Therefore, by recursion, we have 
f(G K ) > -±rf(0) + (1 - 4^)/(Ga-i) 



K, 



7) "I) 



i=0 



1 f - *lO)^ y 



1-(1- 



(ii) Using a similar argument as part (i), we have 

f(Gi) - f(Gi-!) > t^— — © O) - 
1 — 7?" 

> T^(/( G -i) ~ /( G -i) + (! - e(Gi-i))/(0)). 
Therefore, by recursion, we have 

A 

/(Ga) = E(/( G <) - /(^-i)) 

i=l 
A 



^E^a-^-i))/^) 



1 ^ 

2—1 ' 



>-t?(1-. max e(G0)/(O). 

A l— 1 , . . . ,iv — 1 



12 



Appendix B 
Proof of Proposition 2 

(i) Using the definition of total backward curvature, we have 

f(G K © O) - f(0) > (1 - a(0))f(G K ), 
which implies that 

f(G K © O) - f(G K ) > f(0) - a(0)f(G K ). 
Using a similar argument as that of Theorem 5, we know that 

f(G K © O) - f(G K ) < fjf(G K ). 
Therefore, we have 

f(G K ) > r— — (n , f(0). 
rj + (7(0) 

(ii) Using the definition of total forward curvature, we have 

f(G K © O) - f(G K ) > (1 - e(G K ))f(0). 

Using a similar argument as that of Theorem 5, we know that 

f(G K © O) - f{G K ) < fjf(G K )- Therefore, we have 

f(G K ) > l ' e{GK) f{0). 
V 
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